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* 


"Problem  solving"  in  this  Note  refers  only  to  the 
planning  phase  of  robot  activity. 


I  INTRODUCTION 

In  the  original  robot  problem-solving  system  based  upon  an  idea 
1  ^ 

presented  by  Green,  situations  were  described  by  axioms  of  first-order 
logic  that  explicitly  included  terms  representing  states .  Theorem  prov¬ 
ing  by  resolution  was  then  used  to  prove,  constructively,  the  existence 
of  a  state  having  the  properties  of  a  desired  goal.  The  major  disadvan¬ 
tages  of  that  approach  were 

(1)  All  unchanged  and  irrelevant  properties  of  the  world  must 
be  re-established  after  every  state  transistion; 

(2)  The  efficiency  of  the  system  is  very  sensitive  to  the  choice 
of  domains  and  predicates  used  in  the  logical  encoding,  so 
that  sometimes  the  most  "natural"  representations  do  not  lead 

to  practical  task  descriptions. 

2 

Waldinger  has  proposed  a  scheme  for  getting  around  these  problems 
by  extending  the  logic  to  handle  sets  and  tuples  (still  keeping  an  explicit 
state  variable  around) .  In  addition  to  requiring  a  much  more  complicated 
unification  procedure,  this  approach  restricts  severely  the  theorem 
prover's  ability  to  generate  important  intermediate  subgoals,  and  re¬ 
quires  bookkeeping  procedures  whose  details  have  not  yet  been  worked  out. 
Further  study  is  necessary  to  determine  the  feasibility  (and  desirability) 
of  this  approach. 

For  several  months  Fikes ,  Munson,  Nilsson,  and  Raphael  have  been 
exploring  the  possibility  of  a  problem-solving  system  based  upon  first- 
order  logic  but  without  state  variables.  Some  of  these  deliberations  have 
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appeared  in  informal  memos  that  are  partially  included  in  Reference  3. 

The  basic  idea  is  to  describe  a  state  by  a  set  of  axioms,  and  a  state 
transition  (an  action)  by  an  operator  that  makes  specific  modifications 
(deletions  and  additions)  to  the  set  of  axioms.  This  Note  is  a  detailed 
proposal  for  one  version  of  such  a  system. 

II  TERMINOLOGY 

A  state  corresponds  to  our  intuitive  notion  of  a  complete  physical 
situation.  The  domain  of  our  logical  formalism  will  include  physical 
measurements  such  as  object  positions,  descriptions,  etc.  Therefore, 
every  consistent  sent ence  of  first-order  logic  is  either  true  or  false 
for  every  state.  We  think  of  each  such  sentence  as  a  predicate  that 
defines  a  set  of  states,  namely  those  for  which  it  is  true.  We  call  such 
a  set  of  possible  states  the  context  defined  by  the  predicate. 

We  shall  find  it  convenient  to  allow  certain  distinguished  variables, 
called  parameters ,  to  occur  in  predicates.  Since  each  such  predicate 
with  ground  terms  substituted  for  parameters  defines  a  context,  a  predicate 
containing  parameters  may  be  thought  of  as  defining  a  family  of  possible 
contexts — and  each  partial  instantiation  of  parameters  in  the  predicate 
defines  a  subfamily  of  contexts  (or,  if  no  parameters  remain,  a  specific 
context) . 

For  example,  the  predicate  At(Boxl,L)  defines  a  context  (the  set  of 
all  states)  in  which  object  Boxl  is  at  position  L.  If  x  and  y  are  param¬ 
eters,  At(x,y)  defines  the  family  of  contexts  in  which  some  object  is 
located  any  place.  At (Boxl, y)  is  a  subfamily  of  this  family  in  which  the 
object  Boxl  must  be  located  (at  some  as  yet  unspecified  place) . 
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A  problem  to  be  solved  is  specified  by  a  particular  predicate 
called  the  goal  predicate .  The  problem,  implicitly,  is  to  achieve  a 
goal  state ,  i.e.,  produce  any  member  of  the  context  defined  by  the  goal 
predicate . 

If  predicate  PI  defines  a  context  Cl,  then  the  negated  predicate 
~P1  defines  the  complimentary  context  Cl,  i.e.,  Cl  fl  Cl  =  cp  and  Cl  U  Cl 
the  set  of  all  possible  states  .  If  PI  and  ~P2  define  two  contexts  Cl 
and  C2  respectively,  then  the  predicate  PI  A  ~P2  defines  their  inter¬ 
section  Cl  0  C2  .  If  PI  A  ~P2  is  contradictory,  then  PI  =*  P2 ;  this  is 
equivalent  to  saying  that  if  Cl  fl  C2  =  cp,  then  Cl  C  C2,  so  any  state  in 
Cl  is  also  in  C2 . 

In  the  following  we  shall  assume  that  each  predicate  is  placed  in 
the  form  of  a  set  of  clauses  so  that  resolution  may  be  used  to  derive 
consequences  and  deduce  contradictions. 

An  operator  consists  of  an  operator  name ,  a  parameter  list ,  and 
two  predicates — the  preconditions  and  the  results .  In  addition,  any 
units  in  the  clause  form  of  the  preconditions  may  be  designated  as 
transient  preconditions.  An  example  of  a  simple  robot  operator  is 

Operator  name :  push 

Parameter  list:  (x,p,q) 

Preconditions:  [At(x,p),  At(Robot,p),  Sameroom(p,q)] 

Transients:  At(x,p),  At (Robot, p) 

Results:  [At(x,q),  At(Robot,q),  Sameroom(p,q)} 

We  shall  summarize  an  operator  description  by  a  chart  as  follows  (tran¬ 
sients  are  underlined) : 
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push(x,p,q) 

At(x,p) 

At(x,q) 

At (Robot, p) 

At (Robot ,q) 

Sameroom(p,q) 

Sameroom(p,q) 

We  shall  generally  use  the  symbol  K  to  denote  the  preconditions  of 

op 

operator  0£,  and  R  to  denote  its  results. 

Ill  MAIN  IDEAS 

The  conjunction  of  predicates  (and  tuples)  in  the  robot’s  model 
of  the  world  is  an  initial  predicate  I,  defining  as  an  initial  context 
the  set  of  all  states  that  have,  in  common,  all  the  known  properties  of 
the  robot's  current  world.  The  goal  context,  defined  by  a  given  goal 
predicate,  is  the  set  of  satisfactory  target  states.  When  an  operator 
is  applied  in  a  context,  it  changes  the  defining  predicate  (in  a  certain 
way  to  be  discussed  below),  thereby  changing  the  context.  The  problem¬ 
solving  task  is  to  construct  a  sequence  of  operators  that  will  transform 
the  initial  context  into  a  subset  of  the  goal  context. 

Any  context  that  can  be  reached  from  the  initial  context  by  a 
finite  sequence  of  operators  is  called  an  achievable  context.  Any  con¬ 
text  from  which  a  subset  of  the  goal  context  can  be  reached  by  a  finite 
sequence  of  operators  is  called  a  sufficient  context.  The  main  task 
may  be  restated,  then,  as  finding  an  operator  sequence  to  show  that  the 
goal  is  achievable,  or  that  the  initial  context  is  sufficient,  or,  more 
generally,  that  some  achievable  context  is  a  subset  of  some  sufficient 
context  (and  therefore  is  itself  sufficient) . 
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The  problem-solving  strategy  will  frequently  use  QA3  (and  its 
strategies)  .  In  addition,  a  new  executive  is  needed  to  select  the  calls 
to  QA3 .  This  executive  can  be  extremely  simple  at  first;  eventually,  it 
may  be  given  sophisticated  heuristics  of  its  own  for  guiding  its  selection 
of  trial  operators. 

The  main  loop  of  the  problem  solver  consists  of  two  steps  : 

(1)  Test  whether  any  known  achievable  context  is  a  subset  of 
any  known  sufficient  context.  If  so,  we  are  done. 

(2)  Either  generate  a  new  achievable  context  by  applying  some 
operator  in  a  known  achievable  context  ("working  forwards”), 
or  generate,  as  a  new  sufficient  context,  one  which  would 
become  a  known  sufficient  context  by  the  application  of  some 
operator  ("working  backwards") .  Then  return  to  step  1  to 
test  the  newly  generated  context. 

For  the  remainder  of  this  Note,  let  P^  be  a  predicate  defining  an 
achievable  context,  and  P  define  some  sufficient  context.  Step  1  of 

O 

the  main  loop  process  can  be  performed  by  a  resolution  theorem  prover 

(say,  QA3)  simply  by  trying  to  prove  P  =>  P  ,  i.e.,  deduce  a  contra- 

A  o 

diction  from  P  A  HP  .  For  step  2,  we  need  to  consider  how  to  use  opera- 

A  o 

tors  . 

In  order  to  apply  an  operator  in  a  context,  the  preconditions  K 
of  the  operator  must  be  satisfied  in  the  context.  This  applicability 
can  be  assured  (by  QA3)  by  proving  that  the  predicate  of  the  context 
implies  the  existence  of  parameter  values  that  make  the  preconditions 
true.  For  example,  the  push  operator  described  above  is  applicable  to 
an  achievable  context  A  provided 
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P  =»  (3x,p,q) [At (x,p)  A  At  (Robot,  p)  A  Samerooni  (p  ,q)  ] 

n. 

is  a  theorem,  or  equivalently  if 

P  V  At(x,p)  V  ~At (Robot ,p)  V  ~Sameroom(p,q) 
is  contradictory.  If  this  proof  is  completed,  we  may  generate  the  predi¬ 
cate  P„ /  for  the  new  achievable  context  as  follows  : 

A 

(1)  Instantiate  the  operator's  parameters,  preconditions,  and 
results  with  the  parameter  values  determined  (say,  using  an 
Ans  literal)  from  the  above  applicability  proof.  (Parameters 
that  were  not  instantiated  in  the  proof  remain  as  free  param¬ 
eters  .) 

(2)  Delete  from  P^  every  clause  subsumed  by  any  instantiated 
transient  precondition  (because  such  clauses  need  only  be 
true  prior  to  applying  the  operator) . 

(3)  Conjoin  to  the  resulting  predicate  the  instantiated  operator's 
results  (because  such  clauses  must  be  true  after  applying  the 
operator) . 

The  resulting  predicate  is  P  , . 

In  working  backwards,  we  wish  to  find  an  operator  (with  parameters 
p)  whose  results  R  logically  imply  the  predicate  P  of  a  sufficient  con- 

O 

text,  i.e.,  such  that  (3p)  [R  =*  P  ]  is  true,  or  equivalently  (Vp)  [R  A  ~P  ] 

O  b 

is  contradictory.  (The  proof  of  this,  of  course,  is  a  job  for  QA3.)  If 
such  an  operator  is  found,  then  the  (appropriately  instantiated)  pre¬ 
conditions  of  the  operator  constitutes  the  predicate  P  /  that  defines  the 

b 

new  sufficient  context. 

Example :  Finding  a  path  through  a  directed  graph  provides  a  very 
simple  example  of  this  problem-solving  approach.  Suppose  we  wish  to  get 
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from  A  to  D  in  the  directed  graph : 


We  shall  abbreviate  by  ^  the  predicate  that  gives  the  graph’s  topology: 


Path  (A, B)  A  Path(B ,C)  A  Path(C,D)  A  Path(A,F)  A  Path(E,D) 

The  initial  predicate  is  I  =  At (A)  t\  Jt.  The  goal  predicate  is  G  =  At(D) . 
The  operator  j*o  is  defined  by : 


go(x,y) 


At(x) 

Path (x , y) 


At  (y) 


From  I  and  the  negation  of  the  precondition  ~At (x)  V~Path(x,y)  V  Ans (x,y) 
we  can  get  two  proofs:  Ans(A,B)  and  Ans(A,F).  Therefore,  the  go  operator 
can  be  used  two  ways  to  generate  new  achievable  contexts  Cl  and  C2,  with 
corresponding  predicates  P  =  A  At(B),  P  -  ^  A  At(F).  To  keep  track 

of  actions  and  instantiations,  we  shall  draw  a  context  graph : 


Similarly,  from  Cl  and  the  negation  of  the  precondition  we  prove  the 
applicability  of  go(B,C)  which,  when  applied,  gives  C3 

PC3  =  /ft\  At  (C) 

To  illustrate  working  backwards,  consider  whether  the  result  of  a  go 
implies  G.  From 


~(3y)[At(y)  =>  At  (D)  ]  , 
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or  equivalently 


[At(y)  V  Ans (y) ]  A  ~At (D) 

we  get  a  proof  with  Ans (D) ,  so  a  new  sufficient  context  is  given  by 

PC4  =  At (x)  A  Path(x,D) 

(Note  that  C4  is  really  a  family  of  contexts ,  because  of  the  parameter 
x.  This  complication  will  be  discussed  further  in  the  next  section.) 
The  context  graph  is  now: 


Finally,  we  get  a  contradiction  from  P  A  ~p  ,  and  the  proof  of  that 
contradiction  determines  that  x  =  C. 


IV  FURTHER  DETAILS 

Several  difficulties  arise  when  we  try  to  use  this  approach  in 
more  complicated  situations.  We  shall  now  examine  the  major  difficulties 
and  see  how  they  may  be  overcome . 

A .  Parameters 

Whenever  a  new  context  is  generated,  the  defining  predicate 
may  contain  uninstantiated  parameters.  These  then  should  be  thought  of 
as  parameters  of  a  family  of  predicates  defining  a  family  of  contexts . 
Since  we  have  complete  freedom  in  assigning  values  to  these  parameters , 
the  theorem  prover  may  treat  parameters  just  like  ordinary  (universally 
quantified)  free  variables.  However,  the  act  of  i ns tant i at ing  a  parameter 
creates  a  new  subfamily  of  contexts .  Parameters  do  not  obey  the  renaming 
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rules  of  variables,  but  rather  keep  their  identities  throughout  a  set  of 
clauses .  When  a  resolution  operation  causes  a  parameter  to  be  instanti¬ 
ated,  the  resultant  clause  should  be  thought  of  as  having  been  derived 
only  in  a  context  in  which  the  parameter  has  been  appropriately  instanti¬ 
ated  wherever  it  occurs  .  Of  course,  the  parent  context  family  is  still 
available  to  permit  other  instances  of  the  same  parameter  to  be  used 
separately.  Therefore,  the  context  graph  in  the  above  example  should 
really  be  as  follows  (arrows  indicate  operator  applications) : 


where  C47  is  a  context  in  the  family  C4. 

B .  Augmented  Predicates  and  Restricted  Contexts 

Suppose  P  is  a  resolvent  of  a  clause  CL1  e  P  and  a  clause 

Jj  A 

CL2  e  ~P  .  If  P  =  □  (or,  equivalently,  if  we  can  prove  immediately  that 

o  B 

P^  is  not  satisfiable) ,  we  are  through,  for  we  have  shown  that  P.  =>  P  . 
Otherwise,  however,  what  shall  we  do  with  P^?  We  should  not  just  forget 
it  because  it  may  be  a  useful  intermediate  result  in  the  overall  proof. 

Observe  that,  if  we  augment  a  predicate  by  conjoining  a  new 
clause  to  it,  we  restrict  the  context  defined  by  the  predicate  by  select¬ 
ing  that  subset  of  the  context  which  satisfies  the  new  clause.  Any  such 
restriction  of  a  sufficient  context  is  therefore  itself  sufficient. 

In  the  present  case,  we  have  proven  that  [CL1  A  ~P  =»  P  ] , 

o  B 

which  is  equivalent  to  proving  [CL1  A  ~p  =>  P  ] .  If  we  augment  P  by 

Jo  B  o 
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CL1,  this  establishes  that  ~P  defines  a  new  sufficient  context,  pro- 

_ B  _  _  _ 

vided  we  insure  as  a  side  condition  that  CL1  is  true  at  each  step  in 

proving  the  achievability  of  the  ~P  context.  This  will  not  be  diffi- 

B 

cult,  since  a  clause  true  in  any  context  is  true  in  all  following  con¬ 
texts  unless  explicitly  deleted  (by  subsumption  by  a  transient  pre¬ 
condition  of  an  operator) .  One  way  to  keep  track  of  augmenting  literals 
is  to  include  them  in  the  new  sufficient  predicate,  but  with  a  special 
identification  flag  that  makes  them  invisible  to  the  problem  solver  until 
all  other  literals  are  gone  (proven) .  At  the  final  step,  all  augmenting 
literals  reappear  and  their  truth  must  be  verified. 

C .  Conditional  Operations 

Suppose  we  cannot  completely  prove  the  applicability  of  an 
operator's  preconditions  in  an  achievable  context  (or,  similarly,  the 
adequacy  of  an  operator's  results  for  guaranteeing  a  sufficient  context). 
The  intermediate  results  generated  during  such  attempts  may  still  be 
useful,  so  we  must  determine  their  roles  in  the  overall  scheme. 

Consider  first  the  case  of  establishing  applicability.  Let 
A  be  an  achievable  context  defined  by  predicate  P^.  Suppose  from 
P^  A  ~K,  QA3  cannot  deduce  a  contradiction  but  instead  deduces  some 
resolvent  P  .  If  P^  could  be  immediately  proven  false  in  A,  then  the 
operator  would  be  applicable;  however,  in  that  case  □  is  deducible  from 
P  A  ~K  and  we  need  not  be  concerned  with  P  .  In  one  significant  case, 

A  U 

on  the  other  hand,  it  is  more  convenient  to  delay  this  deduction  of  □  . 
This  is  the  case  in  which  P^  contains  parameters.  Although  P^  may  be 
provably  false  for  certain  parameter  values,  it  is  more  flexible  to  leave 
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the  choice  of  parameters  until  a  later  stage  (in  a  following  context) . 
This  can  be  done  by  applying  the  operator  as  before,  but  replacing  the 
operator's  results  R  by  [R  V  P  ]  in  the  predicate  of  the  new  achievable 
context.  If  Pp  is  subsequently  proven  false,  this  tentative  operator 
usage  will  have  been  justified.  If  P^  turns  out  to  be  satisfiable,  then 
R  automatically  will  become  irrelevant  for  future  inferences  and  the  new 
context  will  essentially  degenerate  to  a  useless  superset  of  its  prede¬ 
cessor.  Caution :  Any  eventual  proof  of  the  falsehood  of  PQ  must  be 
achieved  with  clauses  that  remain  continuously  true  from  the  context  of 
P  through  the  context  in  which  the  proof  of  falsehood  is  achieved.  It 

rl. 

would  be  meaningless  to  prove  that  an  operator  was  applicable  at  one  time 

by  using  facts  introduced  by  another  operator  at  a  later  time.  This 

time  dependence  of  literals  creates  a  significant  bookkeeping  problem. 

An  analogous  problem  exists  in  the  "working  backwards"  case. 

If  from  [R  A  HP  ]  we  deduce  P  ,  then  K  defines  a  new  sufficient  context 
b  JJ 

only  if  P^  is  false  in  the  context  of  .  If  K7  is  the  appropriate 

instance  of  K,  then  the  new  context  is  defined  not  by  K7  but  by  [K7  A  ~P^] 

and  we  must  do  the  bookkeeping  necessary  to  insure  that  the  literals  of 

~Pp  are  "resolved  away"  only  by  clauses  that  remain  true  through  the 

context  defined  by  P  . 

b 

V  EXAMPLE 

Without  worrying  yet  about  the  details  of  bookkeeping,  answer 
tracing,  or  proof  strategies,  we  now  present  a  solution  illustrating 
"working  forwards,"  "working  backwards,"  augmenting  literals,  and  con¬ 
ditionally  applied  operators,  to  "the  three-box  problem":  Three  boxes 
are  scattered  around  the  room,  and  the  robot  is  sitting  in  the  corner. 
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He  must  bring  the  three  boxes  together.  (A  context  graph  appears  at 
the  end  of  the  solution.) 


p  :  At(a,.£  )  A  At(b,£  )  A  At(c,£  )  A  At(rob,£.) 

I  — . a - . — -  b  . -  c  - . c 

P„  :  Ox)  [At (a, x)  A  At(b,x)  A  At(c,x)] 

u 


Operators : 

go(x,y) 

push (u, v,z) 

K 

go 

E 

go 

K  . 
push 

E  - . 

push 

At  (rob,x) 

At  (rob,y) 

;  At  (rob,  v) 

At (rob,z) 

At  (u,  v) 

At (u,z) 

1.  (Working  forwards.)  Is  go  applicable  to  context  I? 

From  [PT  A  ~K  ]  deduce  □  with  x  =  Jh  .  Apply  go(£  ,y)  producing  the 
1  go  d  d 

class  of  contexts  Cl. 

P  :  At(a,J&  )  A  At(b,£,  )  A  At(c,i,  )  A  At(rob,y) 

Cl  a b  -  c 

2.  Is  push  applicable  to  any  context  of  Cl?  From 

[P„,  A  ~K  ,  j  =  P  A  (~At (rob , v)  V  ~At(u,v))  can  deduce  □  with,  e.g., 
Cl  push  Cl  .... 

u=a,  y=v  =  £  .  Apply  push (a, A  ,z)  to  Cl',  the  instance  of  Cl  in 
a.  a. 

which  y  =  This  produces  a  new  context  class  C2  with  parameter  z. 

P„  :  At(b,£.)  A  At(c,J&  )  A  At(rob,z)  A  At(a,z) 

02  b  c 

3.  (Let's  test  for  a  solution.)  Is  (any  instance  of)  C2 
a  subset  of  G?  Construct  ~P„ : 

Cl 

~P  •.  ~At(a,x)  V~At(b,x)  V  ~At(c,x) 

u 

From  P_0  A  ~p  we  cannot  deduce  n  but  we  can  deduce,  e.g.,  (by  resol v- 
ing  on  the  b  literals)  ~At(a,j6  )  V  ~At(c,£  ). 
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Enclosing  augmenting  literals  by  wedges,  we  thus  get  a  new  sufficient- 
context  G/  : 


P„/  :  At  (a, A.)  A  At(c,A  )<A  At(b,J&.)> 

G  b  b  b 

4.  (Let's  try  working  backwards.)  Can  push  lead  to  G/? 

From  R  ,  A  ~P  ,  =  At(rob,z)  A  At(u,z)  A  E—At  (a,J&.)  V  ~At(c,£  ){V  ~At(b,4  ))] 
push  G  b  b  b 

we  cannot  deduce  □  but  we  can  resolve,  say,  on  the  c  literal  and  get 

~At (a,^) (V  ~At (b,^^) )  with  u  =  c,  z  =  Jk  .  Conditionally,  apply  push(c, v»J&  ) 

backwards  to  G/  to  get  context  class  HI  (with  parameter  v) 

©  © 

P„.  :  At(rob,v)  A  At(c,v)  A  At(a,£  )<A  At(b,4,)) 

HI  b  b 


where  two  literals  have  been  flagged  to  be  proven  only  from  facts  true 

in  context  G' .  (Note  that  if  we  ever  do  execute  the  push  transition  from 

HI  to  g',  then  the  robot  will  be  at  A,  in  context  G* — but  this  fact  was 

b 

not  used  and  therefore  is  irrelevant  to  the  present  proof  structure.) 


5.  (Another  solution  test.)  Does  P  imply  P  ?  From 

HI 

©  © 

P  A  ~p  =  P  A  [~At (rob , v)  V  ~At(c,v)  V  ~At (a,4  ) <V  ~At(b,4  ) ) ] 

C  2  HI  C*  ^ 

we  can  resolve  the  last  clause  on  the  a  literal,  which  instantiates  z  in 
C2  producing  C2/  : 

P  ,  :  At(b,iJ  A  At(c,je  )  A  At(rob,JiJ  A  At(a ,£) 

C  2  D  O  D  D 

and  a  new  sufficient  augmented  context  Hl/  : 

© 

PTT.  /  :  At(rob,v)  A  At(c,v)(A  At(a,4  )  A  At(b,J©)> 

HI  b  b 

(If  the  a  literal  augments  HI,  it  will  satisfy  the  G/  constraint.) 

6.  (Continuing  the  solution  test.)  Does  P00/  imply  P  /? 

HI 

With  v  =  we  get,  from  P^y  A  ~PH1/  » 


13 


7 


PHl" 


At(rob,L  ) (A  At(c,A  )  A  At(a,^.)  A  At(b,X_ 
c  c  b  b 


)> 


(Working  backwards  again.)  Can  the  go  operator  guaran¬ 


tee  HI  ?  From  A  ~P^,/  >  with  y  ~  f,c>  we  can  deduce  only  the  augment¬ 
ing  literals.  Apply  goix,^^)  conditionally  backwards  to  Hl/;  . 


@  ^hi; 


PTIO  :  At  (rob ,  x)  (A  At(c,£  )  A  At(a,£,)  A  At(b7#T)) 
H2  ebb 


where  new  flags  have  been  added  to  constrain  the  proof  of  the  carried-over 
literals . 

8.  (Finally.)  Does  C2/  imply  H2?  Yes  I  From  P  '  A  ~P 

Cz  HZ 

we  first  deduce  only  the  augmenting  literals  (by  setting  x  =  JL  )  »  and 

then  they  become  visible  and  can  all  be  resolved  away,  completing  the 

proof.  In  justifying  these  final  resolutions  with  flagged  literals,  we 

must  check  that  the  operators  that  will  get  us  to  Hl^  and  G/  will  not 

delete  the  required  literals  from  C2y . 

From  the  context  graph  (below)  we  can  now  read  the  solution: 

Go  from  A  to  £  ,  push  a  from  &  to  ,  go  from  to  &  ,  push  c  from 
da.  a  d  be 

&  to  SL,  ,  and  we  will  have  achieved  the  goal, 
c  b 

This  context  graph  contains  a  single  path,  rather  than 
numerous  multiple  branches,  because  we  judiciously  chose  only  correct 
steps  in  the  above  example.  In  practice  the  graph  may  be  expected  to 
show  many  false  tries.  The  efficiency  of  the  entire  scheme  depends  upon 
bookkeeping  and  strategic  matters  such  as  those  discussed  below. 


VI  IMPLEMENTATION  CONSIDERATIONS 
A .  Bookkeeping 

Several  bookkeeping  problems  threaten  the  practicality  of  a 
problem-solving  system  such  as  the  one  discussed  above.  Our  purpose 
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go (4  .y) 

- —  Cl 


y  =  i. 


push(a,j£  ,z) 


push(c,v,A  ) 

HI  - > - G' 

/  \ 

[At (a, A  )]  \ 


x  = 

[At (b,A  ) ] 
b 


Cl 


C2 


HI 


Z  =  Ji, 


[At(c,4  )] 
c 


C2 


go (x,i  )  /  V 

H2  - —  Hi" 


x  =  A, 


□ 


CONTEXT  GRAPH 


in  this  section  is  to  identify  the  major  difficulties  and  suggest  how 
they  might  be  handled;  of  course,  all  the  details  of  an  implementation 
have  not  yet  been  worked  out . 

1.  Context  Graph 

The  partial  solutions  developed  during  the  problem¬ 
solving  process  are  not  automatically  kept  within  the  derived  logical 
expressions,  as  they  would  be  in  a  system  using  state  variables.  There¬ 
fore,  some  extra-logical  structure  is  necessary  to  "remember"  the  actions 
and  instantiations  that  lead  to  any  particular  clause.  The  context  graph 
holds  precisely  this  information.  Therefore  one  needs  to  store  with  each 
clause  the  identification  of  its  context,  and  maintain  a  separate  list- 
structure  representation  of  the  context  graph  from  which  to  determine 
the  relationships  between  contexts  and  to  reconstruct  the  problem's 
solution  after  its  existence  has  been  determined. 

2 .  Implicit  Context  Membership 

Perhaps  the  conceptually  simplest  logical-expression 
memory  would  consist  of  a  set  of  complete  predicates,  one  for  each  con¬ 
text  occurring  in  the  context  graph.  However,  this  would  entail  much 
wasted  space  and  time  spent  copying  clauses  from  one  predicate  to 
another.  In  particular,  the  initial  context  may  be  defined  by  a  large 
number — perhaps  hundreds  and,  eventually,  thousands — of  clauses  describ¬ 
ing  the  robot’s  world,  almost  all  of  which  are  unaffected  by  any  contem¬ 
plated  actions.  Each  operator  causes  the  deletion  and  insertion  of  only 
a  small  number  of  clauses  as  it  creates  a  new  context.  Therefore,  it 
seems  preferable  to  associate  with  each  clause  the  identity  of  the  context 
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in  which  it  was  first  known  or  created,  and  those  contexts  at  which 


it  was  deleted;  its  presence  in  any  context  can  then  be  determined  from 
the  context  graph .  This  treatment  of  context  identity  would  also  permit 
the  problem  solver  to  keep  all  intermediate  results  in  a  single  uniform 
clause  memory . 

3 .  Instantiation  Bookkeeping 

Instantiation  of  variables  that  arise  from  the  negation 
of  existentially  quantified  variables  in  the  goal  predicate  can  be  traced 
automatically,  as  usual,  by  an  Ans  literal;  the  instances  selected  are 
not  important  until  the  construction  of  the  final  plan.  Parameters 
introduced  by  operators  behave  somewhat  differently .  They  must  be 
traced  during  the  test  of  an  operator's  applicability  (or  sufficiency), 
then  immediately  substituted  into  the  appropriate  places  upon  generation 
of  a  new  context.  The  Ans  idea  will  probably  still  work,  provided  special 
rules  are  worked  out  for  inserting  and  deleting  these  bookkeeping  literals. 
(Remember  that  augmenting  literals,  and  literals  introduced  by  the  con¬ 
ditional  application  of  operators,  also  must  be  handled  in  special  ways 
by  the  theorem  prover.) 

4 .  Complementary  Contexts 

One  complication  in  our  example  solution  to  the  three- 
box  problem  was  a  frequent  negating  of  key  predicates.  This  occurred 
because  we  wished  to  exhibit  the  predicates  that  defined  certain  con¬ 
texts,  but  in  trying  to  deduce  a  contradiction  we  needed  the  predicates 
of  the  complementary  contexts.  However,  except  for  expository  purposes, 
these  negating  operations  do  not  seem  necessary.  We  always  work  with 
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the  predicates  of  achievable  contexts  (and  operator  results) ,  and  the 


predicates  of  the  complements  of  sufficient  contexts  (and  negations  of 
operator  preconditions) .  (These  complemented  sufficient  contexts  con¬ 
tain  what  we  have  previously  called  "shadow  states.") 

B .  Strategies 

Everything  discussed  thus  far  in  this  note  concerns  the 
specification  and  manipulation  of  a  formal  space  containing  problem 
descriptions  and  solutions.  They  key  question  we  have  ignored  so  far  is, 
what  strategy  should  be  used  to  search  for  a  solution  in  this  formal 
space? 

A  quick  answer  is,  any  strategy  you  wish.  We  have  defined  a 
formalism  in  which  states  of  the  world,  operators,  and  tasks  may  be 
easily  and  naturally  stated.  Once  a  few  (hopefully  straightforward) 
details  and  conventions  are  worked  out,  e.g.,  an  internal  representation 
for  the  context  graph,  all  the  mechanical  operations  of  applying  operators 
and  testing  contexts  can  be  implemented.  At  that  time  any  strategy  for 
guiding  the  planning  processes  may  be  superimposed.  Discovery  of  a 
"best"  planning  strategy  is  a  major  research  task,  and  may  be  worked  on 
during  the  next  year  in  parallel  with  other  aspects  of  the  overall  robot 
task,  such  as  the  execution  of  any  plan  and  the  use  of  sensory  data  to 
update  the  model . 

Of  course,  several  extremely  simple  (and  inefficient) 
strategies  are  immediately  apparent,  and  one  or  more  of  these  should  be 
implemented  as  soon  as  possible  just  to  get  things  started.  For  example, 
these  three : 
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(1)  Man-machine .  Every  strategic  decision  is  made  at  the 


teletype  (or  display).  The  man  commands,  e.g.,  "Apply 
operator  go  to  context  C2,"  or  "Test  whether  context 
HI  is  implied  by  Cl',"  and  the  system  responds  with  the 
results  and  an  updated  context  graph. 

(2)  Breadth-first  backwards .  The  system  builds  a  breadth- 

first  tree  of  sufficient  contexts,  trying  to  reach  the 

goal  with  all  possible  operators,  and  testing  each  new 

context  against  the  initial  context  (but  ignoring 

partial  results  from  unsuccessful  tests)  .  This  is 

similar  to  the  natural  strategy  used  by  Waldinger ' s 

2 

state-variable  system,  and  requires  considerably  less 
bookkeeping  than  many  other  strategies.  Other  strate¬ 
gies  of  the  same  type  include  breadth-first  forwards, 
depth  first  with  level  bound,  etc. 

(3)  QA3  strategy .  The  initial  model  clauses,  the  negation 
of  the  goal  predicate,  and  all  the  operator  results  and 
negated  preconditions  are  placed  in  one  big  collection 
and  QA3  is  turned  loose  to  find  a  proof ,  with  the 
negated  goal  predicate  as  set  of  support.  Of  course, 
extra  filters  are  inserted  to  test  the  legitimacy  of 
resolving  clauses  that  may  come  from  different  contexts, 
and  various  QA3  subroutines  are  souped  up  to  maintain 
the  context  graph  and  to  handle  parameters  correctly. 

I  have  no  idea  how  effective  a  problem  solver  this  would 
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be,  but  suspect  that  it  is  significantly  better  that 
those  proposed  in  (2)  above,  while  being  easier  to 
implement  than  a  special  difference-oriented  problem¬ 
solving  strategy  such  as  the  one  currently  being 
developed  by  R.  E.  Fikes • 

VII  FUTURE  PLANS 

The  system  described  above  is  now  a  prime  candidate  for  implemen¬ 
tation  as  the  Planner  for  the  first  PDP-10  robot  system.  Comments, 
criticisms,  detailed  counter  proposals,  etc.,  should  be  presented  within 
the  next  few  weeks  so  that  a  firm  decision  can  be  made. 
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